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TO DETERMINE THE APPLICABILITY OF ELEMENTARY AND 
SECONDARY SCHOOL TEACHER RATINGS ASSIGNED BY PRINCIPALS ON 
THE 1965-66 OFFICIAL FLORIDA TEACHER EVALUATION FORMS, 

ANALYSES OF VARIANCE WERE MADE FOR FOUR SETS OF INDEPENDENT 
VARIABLES AS FOLLOWS-- (1) LEVEL AND RANK FOR A SAMPLE OF l 
SECONDARY AND 92 ELEMENTARY TEACHERS WITH BACHELOR’S DF,„cES 
AND 92 SECONDARY AND 92 ELEMENTARY TEACHERS WITH MASTER'S 
DEGREES, (2) SUBJECT TAUGHT (ART, MUSIC, MATHEMATICS, OR 
ENGLISH) AND SEX FOR A SAMPLE OF FIVE MALE AND FIVE FEMALE 
TEACHERS FOR EACH SUBJECT, (3) RANK AND LEVEL FOR A SAMPLE OF 
52 SECONDARY AND 52 ELEMENTARY TEACHERS WITH MASTER'S CEGREES 
AND 52 SECONDARY AND 52 ELEMENTARY TEACHERS WITH BACHELOR'S 
DEGREES, AND (4) SUBJECT TAUGHT AND YEARS OF EXPERIENCE FOR A 
SAMPLE OF NINE ENGLISH AND NINE MATHEMATICS TEACHERS FOR SIX 
TIME PERIODS OF EXPERIENCE, RANGING FROM ZERO TO 41 YEARS. 
CATEGORIES RATED BY PRINCIPALS INCLUDED TEACHER PERSONALITY 
AND SOCIAL CHARACTERISTICS AND INSTRUCTIONAL CAPABILITIES. 
WHILE EXTENSIVE TABULATIONS OF DATA INDICATED THAT FACTORS 
TESTED DID NOT ACCOUNT FOR A SIGNIFICANT PORTION OF THE 
VARIANCE OBSERVED IN THE RATINGS, LEVEL OF INSTRUCTION 
ACCOUNTED FOR THE GREATEST PROPORTION OF SIGNIFICANT RESULTS. 
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PREFACE: "THE MULTI -STATE TEACHER 
EDUCATION PROJECT" 

The Florida State Department of Education is currently partici- 
pating in the Multi-State Teacher Education Project. This project was 
initiated to strengthen programs of in-service and pre-service teacher 
education. It calls for greater involvement of state departments of 
education and enhanced communication and cooperation among the states in 
assisting teacher preparation institutions and local school districts to 
provide quality teachers and teaching. The seven participating states 
Florida, Maryland, Michigan, South Carolina, Utah, Washington, and West 
Virginia--are each carrying out separate but related phases of the total 

Project. 

Florida is undertaking analyses and interpretations of a large 
volume of data on teachers and on schools which have been assembled. Most 
. of these data are stored on magnetic tape for retrieval and processing 
via computer. This document reports one phase of these analyses. A related 
conceptual study dealing with teacher evaluation has also been completed 
and is available under the title, "Statewide Teacher Evaluation: A Concep- 
tualization of a Plan for Use in State Educational Leadership." 

In addition, this State is preparing documents dealing with various 
aspects of teacher education, particularly with professional laboratory 
experience, and also making use of materials prepared in the other States. 
Meetings and conferences have been held to disseminate and evaluate 
ideas from these sources and to secure further suggestions and new ideas. 

The Multi-State Teacher Education Project is supported by a grant 
from the U. S. Office of Education under Section 505, Title V, Elementary 
and Secondary Education Act of 1965. 
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INTRODUCTION 



This report is a continuation of an earlier collection of analy- 
sis of variance results. The following excerpt from the Introduction to 
Part I relates to the present report also. 

Excerpt from Introduction 
to Part I 

This study was undertaken to isolate factors which can account 
for variance in ratings assigned teachers on the evaluation form adopted 
by the Florida State Board of Education (Form TE-1). This form was de- 
vised in order to implement Chapter 231.29 of the Official Florida 
Statutes which requires that all instructional personnel be evaluated 
annually and that copies of these evaluations be filed with the State 
Superintendent.^" 

In initiating this study, it was assumed that the rating which 
a teacher receives is a function of (a) the status of the qualities or 
traits he possesses, (b) the situation(s) in which he was observed, 

(c) the status of the qualities or traits of the evaluator (i.e., his 
biases), and (d) interaction among (a), (b) , and (c) . 

How These Analyses Differ from 
Those Reported in Part I 

The data reported herein summarizes analyses in which variables 
in the teaching- learning situation were selected on an a priori basis 
and tested for their contributions to variance. With one exception, 



^This statute was amended in the 1967 legislative session. It 
is no longer required that the same form be used by all counties nor 
that copies of the evaluation be filed with the State Superintendent. 



these are the same variables which were tested in Part X. 

The exception is the "evaluator" variable. Results of the analy- 
ses reported in Part I indicate that the only factor which consistently 
contributes a substantial portion to the variance is the evaluator. In 
other words, differences in evaluation practices of individual evaluators 
is the primary factor to which differences in ratings assigned to teachers 
can be attributed. It was stated that if other factors studied do actually 
contribute significantly to the variance, it will be necessary to employ 
larger samples before this can be detected. The analyses reported in 
the present volume were designed to control the "evaluator" variable 
and to provide for the utilization of larger samples. 

Model Schools and Standard Scores 

The limited size of the earlier samples was due to the necessity 
| of having all subjects in a given column or row of cells be persons who 

• were evaluated by the same evaluator. Thus, the evaluator factor and the 
problem of sample size were interrelated. The procedure adopted for 
controlling the evaluator factor and increasing the sample size consisted 
of. (1) selecting each sample from teachers in a group of model schools in 
a single county (rather than from a single school) and (2) converting the 
ratings received by these teachers to standard scores. 

To' identify model schools, every school in a given county was 

. i 

rated on a five-point scale according to the overall quality of instruc- 
tion which is offered in that school. These ratings were performed by 
the central office staffs in three selected Florida counties. The 
category on the five-point scale into which the greatest number of schools 
.were placed represented the mode. The schools in this category repre- 
** sented the model group of schools for that county. In selecting a 

o 
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sample'for any one analysis, the population was limited to teachers from 
one county only. 

The ratings assigned these teachers were then conveited to 
standard scores. Since the overall quality of the teaching in. each of 
the model schools was assumed to be comparable, it was also assumed that 
differences in rating tendencies of individual evaluators would be con- 
trolled if the ratings assigned by all principals were placed on the 
same scale. This could be accomplished by transforming the ratings from 
each school so that means and standard deviations from all schools would 
be equal. This method of converting ratings to standard scores was 
employed, thus eliminating the "evaluator" variable. It should be noted 
that the means and standard deviations used with each individual score 
were those of the particular school in which that teacher taught. 

Results 

The factor accounting for the greatest proportion of significant 
results was level of instruction (elementary or secondary). The tests 
which used level of instruction as one effect were run. using rank 
of certificate (bachelors degree or masters degre) as the other effect. 
The results indicate that when the effect of rank is taken into account 
also, the level of ratings assigned to elementary teachers differs from 

the level assigned to secondary teachers. 

Two- thirds of the significant results were obtained with the 
tests utilizing certificate rank and level of instruction as factors. 
These tests comprised only half of the total tests conducted. There was 
virtually no interaction detected between certificate rank and level of 
instruction. Nor was there interactions between the other factors. 

When the results of the analyses reported herein are compared 

with those reported in Part I, it appears that increasing sample size 

- 3 - 



did lead to a greater number of significant results. There were 368 
possible significant F ratios in the analysis reported in Part I; 192 
of these involved the evaluator effect (either alone or as a factor 
in interaction) and 176 did not involve the evaluator effect. The 
factors involving evaluator were significant 267o of the time. The 
factors not involving evaluator were significant 87o of the time. The 
87o figure can be^ompared with the proportion of significant results 
reported in the present volume. Tests utilizing raw scores yielded 

f 

significant F ratios 147© of the time and tests utilizing standard 
scores yielded significant results 18% of the time. The percentage 
figures were obtained by dividing the total number of F ratios which 
were significant at the .05 level by the total number of F ratios cal- 
culated. 

It should be noted, finally, that converting raw scores to 
standard scores had very little effect on the number or pattern of sig- 
nificant results obtained. This fact can be observed by comparing the 
raw score tables and standard score tables which are presented adjacently 
in this report. 
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OFFICIAL FLORIDA TEACHER EVALUATION 



The form on the following page is the 1965-66 version of 
the instrument used to gather data for the analyses summarized in 
this report. The earlier versions of the form which were employed in 
the analyses do not differ substantially from the 1965-66 version. 
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tiove named person to indicate Superior f$up) Satisfactory fSat) or Poor. Make 
arks heavy and dark. The original of this evaluation sheet should be mailed to 
State Department of Education not later than July 10 of each year* If cm- 
loyment is terminated, this report is due immediately. — Please Do Not Fold This 
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THE ABOVE AREA IS RESERVED FOR FUTURE 
OF SOCIAL SECURITY NUMBER. 



USE 



i PERSONAL QUALIFICATIONS 



! I RELATIONSHIPS WITH OTHERS 



A. Is Healthy and Emotionally Stable 

B. Is Neat and Well Groomed In Appearance, 

C. Thinks Logically and Makes Practical Decisions 

D. Is Accurate __ . „ ^ . - ~ . .. . . . — 

E. Is Punctual . . . . » „ - . . . . — - — 

F. Takes Necessary and Appropriate Action On His Own — 

G. Is Dedicated to His Profession — __ — — * — _ — ... 

A, U Respected by Pupils. — . — 

B. Is Responsible and Dependable. . ~ 



SUP. SAT. POOR 



— s 



C. Is Friendly Understanding, Sympathetic with 

Community, Other Staff Members & Administration , 



HI TEACHING SKILLS ABILITY 



D. Is Morally Upright > 

E, Is Profe* sionaM / Eth'cal . .. 

A. Know , Subject Matter — , . 

B. Take, Action to Improve Himself. _ 



YES NO 



SJP. SAT. POOR 



C. Uses Instructional Materials cmd Lesson 
Plans Effectively . - * 



D. Develops Pupil Interest and Eagerness to learn — .. 

E. Maintains Pupil Control ............ — 

F. Uses Material In Cumulative Folder „ 

IV WOULD YOU RECOMMEND THIS TEACHER FOR RE* EMPLOYMENT? — — 

A. Reappointed - - ~ 



YES NO 



V Status of Teacher, Principal, Supervisor or 
Junior College Instructor For the Next School 
Year. 



PRINCIPAL 



O A T F SIGNED 



"T 



' MO. 



DAY 



YR. 



B. Leave Gi anted . .... . - -- — — zzzzz 

C. Resigned*...*, ... .. . — ----- 

D. Make no entry. For machine use only. — — — 

E. Holds or has been recommended for continuing contract - r::: 

F. Retired* _ — ----- 
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COMPOSITE SUMMARIES OF ALL ANALYSES 



The tables on the following two pages contain a summary of the 
significant results for all of the analyses reported in this volume. 

The first table relates to analyses employing data in raw score 
form. The second table relates to the same data after they have been 
converted to standard score form. 

These tables constitute a cryptic statement of the fact that the 
factors tested do not account for a significant portion of the var- 
iance observed in the ratings. 

A word of caution is in order for persons using these tables. 

Since the results of several analysis of variance tests are not 
customarily combined in one table, the following tables have been 
interpreted by some as being a report of one many-factored analysis of 
variance. This, of course, is not the case. Each table is a com- 
pilation of sixteen different analyses with each of four different 
samples. The individual source tables for each analysis are included on 
subsequent pages of this report. 
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A COMPOSITE SUMMARY OF SIGNIFICANT EFFECTS DETECTED IN SEVERAL DIFFERENT PILOT STUDIES 
USING DATA* FROM THE OFFICIAL FLORIDA TEACHER EVALUATION REPORTS 
AND EMPLOYING THE ANALYSIS OF VARIANCE TECHNIQUE 
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* The analyses summarized in this table were carried out using data 
converted to standard scores. 



THE EFFECTS OF LEVEL AND RANK UPON RATINGS ASSIGNED 
BY PRINCIPALS ON THE 1965-66 OFFICIAL FLORIDA 
TEACHER EVALUATION FORMS ON A SAMPLE OF 
ELEMENTARY AND SECONDARY TEACHERS 



Technique: The Analysis of variance technique was used. Two 

sets of analyses were carried out. The first used the data 
in raw score form. For the second, the data were converted 
to standard scores. (For further explanation, see "Intro- 
duction. ") 

Independent Variables: (A) Level of assignment (Secondary or 

Elementary), and (B) Rank of Certificate (Masters or Bachelors.) 

Dependent Variable: Ratings assigned by principals in the 

1965-66 Official Florida Teacher Evaluation Forms. 

Sample: 92 Secondary and 92 Elementary teachers with a Rank 

I certificate (bachelors degree), 92 Secondary and 92 Ele- 
mentary teachers with a Rank II certificate (masters degree). 

Method for Selecting Sample: Teachers in the modal schools 

were classified according to rank and level. The sample 
was then randomly selected, cell by cell. 



SUMMARY OF SIGNIFICANT RESULTS. IN ANALYSES OF THE EFFECTS OF RANK AND 
LEVEL UPON RATINGS ASSIGNED BY PRINCIPALS ON THE 1965-66 OFFICIAL 
FLORIDA TEACHER EVALUATION FORMS ON A SAMPLE OF ELEMENTARY 
' AND SECONDARY TEACHERS 



Analyses Using Raw Scores 



Item 


A 

EXPERIENCE 
.05 .01_ 


B 

SUBJECT 
.05 .01 


AB 


TOTAL 
, . 05 m 


I A Healthy 
B Neat 

C Thinks Logically 
D Accurate 
E Punctual 
F Action On Own 
-G Dedicated 

II A Respected by Pupils 
B Responsible 
• C Friendly 
III A Knows Subject 

B Action to Improve 
C Plans Effectively 
D Develops Interest 
E Maintains Control 
*F Uses Cumulative 
Folder 


X 

X 

X 


X • 

X 

X 

x 


X 

* 


% 

2 

1 

1 

1 1 
1 

1 


TOTAL 


2 1 


3 1 


1 0 


6 2 
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Analyses Using Standard Scores 
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AB 






R % 


EXPERIENCE 


SUBJECT 






TOTAL 


Item 


105 .01 
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I A Healthy 
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B Neat 

C Thinks Logically 
D Accurate. 

E Punctual 
F Action On Own 
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X 
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X 


• 
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B Responsible 
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III A Knows Subject 
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B Action to Improve 
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C Plans Effectively 
D Develops Interest 


X 
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E Maintains Control 
F Uses Cumulative 
Folder 


X 
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* 




i i 


TOTAL 


4 1 


3 1 


0 


0 


7 2 




Analysis of Variance Source Tables for Analyses Using 
Item 1A, "Is Healthy and Emotionally Stable 11 



Analysis Using Raw Scores 



Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


0.48076577 


1.6462134 


B (Level) 


1 


0.076924926 


0.26340237 


AB 


1 


0.30769169 


1.0535820 


Residual 


204 


0.29204341 







Analysis Using 


Standard Scores 


• 


Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


229.98032 


2.3435712 


B (Level) 


1 


29.267943 


0.29824947 


AB 


1 


78.619161 


0.80115378 


Residual 


204 


98.132422 





* Significant at .05 level 
** Significant at .01 level 



Analysis of Variance Source Tables for Analyses Usin g, 
Item 1B« "Is Neat and Well Groomed in Appearence" 



Analysis Using Raw Scores 



Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


0.58173374 


2.0741071 


B (Level) 


1 


0.12019269 


0.43059980 


AB 


1 

• 1 


0.23557557 


0.84396808 


Residual 


20* 


0.27912853 







Analysis Using 


Standard Scores 




Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


36.0^924 


0.37041617 


B (Level) 


1 


787.42151 


8.0809630** 


AB 


1 


39.964889 


0.41014220 


Residual 


204 


97.441544 





I 



* Significant at .05 level 

** Significant at .01 level 



o 

ERIC 
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Analysis of Variance Source Tables fo. ‘ Analyses Using 
Item 1C, "Thinks Logically and Makes 
Prac tical Decisions* 1 



Analysis Using Raw Scores 



Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


0.30769170 


0.62456891 


B (Level) 


1 


0.17307807 


0.35132303 


AB 


1 


0.94230929 


1.9127493 


Residual 


204 


0.49264652 







Analysis Using 


Standard Scores 


■ 


Source 


Deg.- of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


150.96934 


1.3926230 


B (Level) 


1 


611.83277 


5.6438769* 


AB 


1 


118.12315 


1.0896319 


Residual 


204 


108.40647 





I 



* Significant at .05 level 
** Significant at .01 level 



\ 



o 

ERIC 



- 13 " 



Analysis of Variance Source Tables for Analyses Using 

Item ID, "Is Accurate 1 ' 



Analysis Using Raw Scores 



Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


0.12019269 


0.25353050 


B (Level) 


1 


0.23557907 


0.49692273 


AB 


1 


0.12019269 


0.25353050 


Residual 


204 


0.47407586 







Analysis Using 


Standard Scores 




Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


352.79027 


3.3947811 


B (Level) 


1 


33.827820 


0.32551364 


AB 


1 


8.0306528 


0.077276248 


Residual 


204 


103.92136 








* Significant at .05 level 
** Significant at .01 level 



Analysis of Variance Source Tables for Analyses Using 

Item IE, "Is Punctual " 



Analysis Using Raw Scores 



Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


0.076922924 


0.25547879 


B (Level) 


1 


0.019231230 


0.063871355 


AB 


1 


0.(10Z) 13000000 


0. (10Z) 4317 6001 


Residual 


204 


' 0.30109319 







Analysis Using 


Standard Scores 




Source^ 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


53.722070 


0.52742127 


B (Level) 


1 


189.74341 


1.8628230 


AB 


1 


6.2960144 


0.061811689 


Residual 


204 


101.85799 





* Significant at .05 level 
** Significant at .01 level 



Analysis of Variance Source Tables for Analyses Using 
Item IF, "Takes Necessary and Appropriate 





Action On His 


Own" 






Analysis Using Raw Scores 




Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


0.23557732 


0.78363318 


B (Level) 


1 


0.0048078077 


0.015992871 


AB 


1 


0.38942566 


1.2954000 


Residual 


204 


0.30062193 







Analysis Using 


Standard Scores 




Source 


Deg. of Freedom 


Mean Squares 


F Ratio 


A (Rank) 


1 


28.259871 


0.25166451 


B (Level) 


1 


49.383840 


0.43978120 


AB 


1 


107.32411 


0.95576054 


Residual 


204 


112.29184 





* Significant at .05 level 
** Significant at .01 level 



16 - 



0 



